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Abstract  — While  there  are  by  now  well- 
established  criteria  for  evaluating  serial  algo- 
rithms, such  as  space  and  time  measures,  these 
criteria  car.iiot  be  readily  applied  to  asynchron- 
ous algorltlins.  We  propose  a method  for  the 
evaluation  of  the  performance  of  an  asynchronous 
algorithm.  This  method  is  based  on  the  study  of 
delays  that  ore  often  introduced  when  one  solves 
a synct joniiatlon  problem.  We  then  Illustrate 
this  method  by  proving  results  about  the  efficien- 
cy of  various  solutions  to  synchronization 
problems . 


1. 


A central  problem  in  computer  science  is  that 
of  evaluating  competlrg  algorithms  for  the  same 
task.  In  tie  csoe  that  the  algorithms  are  to  be 
executed  sequentially,  several  evaluation  criteria 
are  commonly  ured.  First,  it  is  easy  to  express 
the  idea  that  two  alcoritijas  "do  the  same  thing" 
by  the  requirtr.ent  that  they  have  the  same  input- 
output  behavior.  Secondly,  given  that  two  algo- 
rithjns  have  the  same  input-output  behavior,  they 
may  be  compered  by  considering  the  execution  time 
required,  nexory  space  required,  numerical  (or 
other  type  of)  stability  and  so  on.  By  controst 
asynchronous  algorithms  cannot  be  evaluated  so 
easily,  due  to  several  important  reasons. 


First,  asynchronous  algorlthjiis  — especially 
those  used  in  operating  systems  — are  not  nec- 
essarily supposed  to  halt.  Indeed,  considerable 
effort  is  often  required  to  guarantee  that  they 
do  not  halt,  l.e.  do  not  deadlock  or  crash. 
Therefore,  It  often  makes  no  sense  to  discuss  the 
input-output  behavior  of  these  asynchronous  algo- 
rithms. Thus  It  is  not  at  all  clear  when  two  such 
algorithms  "do  the  same  thing". 


Anotlier  difficulty  is  that  of  measuring 
efficiency.  Simply  counting  the  number  of  steps 
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required  to  accomplish  a task  does  not  reflect  the 
utilization  of  multiple  processors.  Are  algo- 
rithms requiring  more  steps  — which  can  be  done 
in  parallel  — to  be  preferred  over  those  requir- 
ing fewer  steps  — which  cannot  be  done  in 
parallel?  Similarly,  algorithms  requiring  less 
mcDory  are  not  clearly  superior  if  referencing 
this  rnanory  causes  processor  Interference. 

Since  we  are  mainly  concerned  with  synchron- 
ization, the  questions  of  efficiency  can  be 
stated  as:  How  much  overhead  is  required  (euid  how 
much  is  acceptable)  to  accomplish  process  synchron- 
ization? Will  the  method  we  chose  to  solve  our 
synchronization  problem  cause  delays  or  interfer- 
ence which  are  unacceptable? 

In  this  paper  we  present  a criterion  for  ev- 
aluating asynchronous  algorithms.  Rather  than 
attempt  to  assign  absolute  measures  of  resource 
utilization  — a task  that  may  well  be  impesslble 
to  do  in  a useful  way  — we  define,  relative  to  a 
suitable  measure  of  time,  for  each  r.on-negatlve 
integer  k,  a relation,  simulatev  between  asynchron- 
ous algorithms.  For  asynchronous  algorithms  Q and 
P 

Q slmulate)[  P 

will  mean  that  there  is  a mapping  from  computa- 
tions (state  changes)  in  Q to  computations  in  P. 
This  consideration  of  state  changes  avoids  the 
difficulty  of  non-halting  algorithms  not  being 
input-output  comparable.  The  efficiency  of  this 
correspondence  (l.e.  the  amount  of  overhead  Q 
requires  to  accomplish  the  same  effect  as  P)  is 
measured  by  the  integer  k.  k measures  how  close- 
ly the  "parallelism"  of  Q ar.d  P are  related.  When 
k = 0,  Q uses  multiprocessors  as  efficiently  as  P, 
but  as  k .►  « uses  multiprocessors  less  and  less 
efficiently.  Thus  there  will  be  a sequence  of 
relations 

slmulate^j,  simulate^, . . . 

which  allow  increasing  freedom  with  a correspond- 
ing decrease  in  efficiency. 

8.  The  Model 


We  have  used  a more  "program  oriented"  model 
to  study  related  problems  ([5]  - [6]).  However, 
experience  bas  shown  that,  as  far  as  the  analysis 
of  synchronization  is  ccncerr.ed,  it  is  possible  to 
abstract  the  model  further  to  the  language  theo- 
retic one  which  we  present  below. 
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The  model  will  Ignore  such  issues  as  what  expanded"  version  of  P.  One  can  then  consider  a 

kind  of  language  the  algorithm  is  specified  in, 

how  the  actual  scheduling  is  determined,  and,  most  mapping  M from  P to  Q representing  this  conpils- 


Importantly,  how  the  algorithms  are  actually  im- 
plemented. These  are,  of  course,  important  consid- 
erations, but  it  is  our  contention  that  a study  of 
the  logical  implementation  of  asynchronous  programs 
is  of  prime  importance. 

Let  S be  a finite  set.  Elements  of  I will  be 
thought  of  as  actions  (instructions  or  statements). 
Informally,  a computation  is  any  sequence  of 
actions  that  respects  the  control  flow  of  an 
asynchronous  program  P (we  assate  fixed  initial 
values  of  all  variables  so  that  different  sequences 
represent  true  asynchronous  behavior  and  are  not 
merely  a reflection  of  different  Inputs  to  P). 
Clearly,  if  x is  a computation,  then  so  is  any 
prefix  (initial  subsequence)  of  x.  We  formalise 
this  notion  as  follows. 

Definition:  Let  I be  a finite  non-empty  set. 
An  asynehro-.'jus  program  is  a subset  P of  I*,  the 
set  of  all  sequences  of  elements  of  £,  which  is 
closed  under  the  operation  of  taking  prefixes. 
Elements  of  I are  called  actions  and  elements  of  P 
are  called  comr.utatlons. 

Definition:  Let  P C IJ  be  an  asynchronous 
progrtus.  A cost  f'unction  is  a function  c:LJ  -►  N, 
where  K is  the  set  of  non-negative  integers  which 
is  additive  with  respect  to  concatenation,  l.e. 
e(xy)  = c(x)  + c(y).  Intuitively,  c measures 
"time". 

Let  P c ip  be  an  asynchronous  program  and  c 
be  a cost  function.  Define  a delay  function. 

d^:r*  X Ip  -»  NV{-}  by 

d^(x,f)  = min  {c(y):yel»  and  xyfcP),  where 

d^(x,f)  = «>  if  there  is  no  such  y.  If 

c(x)  = length  (x)  we  will  denote  d^  by  d. 

d (x,f)  measures  the  minimal  amount  of  "time" 
c 

as  measured  Vy  c that  must  elapse  before  f can  ex- 
ecute following  X.  This  quantity  is  important  for 
several  reasons.  In  a real  tine  system,  the  value 
of  d^(x^)  nay  be  critical  to  the  correctness  of 
the  system.  Also,  given  additional  structure  in 
the  nodel,  the  delay  fu.  ctlon  acta  as  a quimtita- 
tive  measure  of  how  well  multiprocessors  can  be 

>itn  i 7,ed, 

When  comparing  two  asynchronous  programs 
P £ rj(  and  Q £ 1^,  it  is  convenient  to  think  of 
one  of  tticn,  s-iy  Q,  as  lirpl  c.-.!'ntlne  the  effect  of 
I’  by  using  mere  primitive  operations.  According 
to  this  view,  Q is  the  "compiled"  or  "macro 


tlon  process.  In  the  nodel  presented  here,  it  will 
be  more  convenient  to  consider  the  "inverse",  say 
h,  of  M,  from  Q to  P.  Thus  a sequence  of  actions 
of  8 in  Q will  be  the  "expansion"  of  a single  action 

g In  P.  The  action  f will  be  considered  to  imple- 
ment the  action  g while  a and  6 will  be  considered 
as  bookkeeping  operations  or  overhead. 

Our  nodel  also  requires  that  h be  a homo- 
morphism which  simply  means  that  flow  of  control 
in  Q is  a copy  of  the  flow  of  control  of  P. 

Formalizing  the  discussion  above,  we  obtain 
the  following 

Definition:  Let  Q and  P be  asynchronous 
programs,  i.e.  Q £ and  PCI*.  Then  h is  a 
decoder  from  Q to  P provided  h la  a string  mor- 
phism from  I*  into  £*,  i.e.,  h(xy)  •=  h(x)h(y)  for 
all  x,y  in  r*  and  h(f)EZ:pt/{A}  for  all  feL^  where 
A is  the  empty  string  and  h(Q)  = P.  ftp^  is 
called  observable  if  h(f)  i a,  otherwise  it  is 
called  a bookkeeping  action. 

We  can  now  define  simulate,  . 

k 

Definition:  Let  Q and  P be  asynchronous 
programs  over  alphabets  and  Ip  respectively, 
and  let  c be  a cost  function  on  1^,  Then 

Q simulate^^  P 

provided  that  there  is  a decoder  h from  Q to  P such 
that  for  all  xeI»  and  f observable, 

h(x)h(f)tP  implies  d^(x,f)  ^ k. 

Intuitively,  if,  after  a sequence  of  actions 
h(x),  P is  not  "stopped"  i.e.  some  action  g may 
proceed,  then  Q may  be  stopped  at  x but  only 
temporarily,  in  the  sense  that  there  Is  a bound  k 
on  the  amount  of  time,  as  measured  by  c,  that  must 
elapse  before  the  action  f corresponding  to  g can 
be  "released".  This  is  our  measure  of  efficiency. 

The  smallest  k such  that  Q simulate.  P will 
be  denoted  by  delay  (a.P).  * 

3.  Examples  and  discussion 

In  this  section  we  Illustrate  the  preceding 
definitions  by  exa.v.ples  from  the  literature.  To 
simplify  the  discussion,  we  will  use  a suggestive 
informal  notation,  as  is  commonly  employed  In 
the  synchronization  literature.  It  should  be 
pointed  out  that  the  advantage  of  the  abstract 
definition  of  an  asynchronous  prograr.  is  its  con- 
ceptual economy  and  aid  in  simplifying  proofs. 

For  describing  particular  examples,  a "program 
oriented"  notation  Is  clearly  preferable.  This  is 
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quite  analogous  to  the  description  of  languages  by 
grajrjnars , 

Consider  the  following  asynchronous  programs 
which  we  take  as  defining  the  semantics  of  the 
"first  reader-writer  problem"  of  [l]  (for  a dis- 
cussion of  the  semantics  of  synchronization  prob- 
lems see  [5],  [6]). 

reader-i  (1  < i ^ n)  writer 

c^!  P(S)  J:  P(S|n) 

e^:  read  k:  write 

hj:  V(S)  1:  V(s|n) 

where  S is  a global  variable  (semaphore)  whose  in- 
itial value  is  n and  P,V  are  Dljkstra's  primitives, 
while  P(s|n).  V(s|n)  are  the  generalizations  of 
these  primitives  [9].  P(sln)  is  an  indivisible 

action  of  the  form 


We  will  now  study  the  relationship  between 
and  P.  First  let  h be  the  mapping  defined  by: 

hCCf)  « Cj 

h{E^)  • e^ 
h(H^)  « h^ 
h(J)  w J 
h(K)  - k 
h(L)  « 1 

li(X)  * A for  all  other  actions  X, 

It  is  not  difficult  to  verify  that  h(Q)  = P.  For 
Instance  the  computation 

AiBiCiDiA^BgCgD^ 

maps  under  h to  c^^Cg. 


when  S_>n^  S^S-n 

the  assignment  S r s - n is  executed  only  when 
S ^ n,  otherwise,  control  is  interrupted  until 
such  tine  as  S ^ n is  satisfied.  V(3|n)  is  an  in- 
divisible action  of  the  form 

when  true  do  S * S n. 

Each  of  the  processes  reader  i and  writer  is 
cyclic  so  that  for  example,  J can  proceed  after 
execution  of  .'kl.  Let  us  denote  the  set  of  compu- 
tations of  this  program  by  P.  For  example, 

CjCg  e P,  while  JCg  < P. 

Now  let  be  the  asynchronous  program  of 
flg’ire  1.  This  program  corresponds  to  the  solution 
to  the  first  reader-writer  problem  found  in  (ll. 

integer  readcount ; (initial  value  0) 

senaphcre  M,W;  (initial  value  1) 

render-1  1 £ i £ n 
Aj  : r(M) 

; readcount  readcount  + 1 
Cj  ; readcount  = 1 then  P(w) 

Dj  : V(M) 

Ej  : real 
Fj  : P(M) 

G.  : readcount  » readcount  -1 

i 

Hj  : readcount  • 0 then  V(W) 

Ij  : V(M) 

writer 
J : r(w) 

K : write  Figure  1.  First  solution 

I,  . v(W)  to  reader-writer  problem. 


We  wish  to  measure  the  efficiency  of  this 
solution.  First,  we  claim  that  for  the  given  de- 
coder h,  simulatCj^  P Implies  k ^ 3.  To  see 
this,  take  x « ^ “ ^2’  short- 
est y such  that  xyfcQ  is  which  exits  from 

the  critical  section  of  reader-l  restores  the  sem- 
aphore M to  1 and  then  enters  the  critical  section 
Ag-Dg  of  reader-2,  Thus  d(x,f)  « 3,  while 
h(x)h(f)  « ” straightforward  analysis 

of  cases,  based  on  the  observation  that  one  need 
execute  at  most  three  actions  between  two  "succes- 
sive" observables,  it  follows  that,  for  this  de- 
coder, k i 3.  Next,  we  claim  that  under  no  de- 
coder hj , can  either  or  be  observable 
actions.  Assume  the  contrary  and  let  h^(Aj)  » Cj . 
Since  A^JeQ  and  since  clearly  hj^(J)  « J, 
h(Aj^j)  « h(Aj^)h(J)  “ c^J  ^ P,  which  is  a contra- 
diction since  h maps  computations  into  computations. 
Similarly,  bj^(Bj^)  ^ c^.  Thus  either  T.^(C^)  = c^ 
for  all  1 and  we  can  argue  as  before  that  k 2.  3f 
or,  for  some  1,  ^^(D^)  « Cj , but,  in  the  latter 
case  d(A,  = 3 so  k £ 3 in  all  eases. 

Hence  delay  (Q^,P)  • 3. 

Thus  Qj  Introduces  new  delays,  but  delay 
(Qj,P)  is  fixed.  Independently  of  the  number  n of 
readers. 

Let  us  now  compare  with  an  alternative 
solution,  Q.,,  represented  in  figure  2. 
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1 


= 1 Initially 

1 2 II 

reader  i 1 < 1 < n writer 


c • 

i 

P(s.  ) 

^1  = 

P(Sj) 

h-- 

read 

J : 
n 

P{Sn) 

»i= 

V(3j) 

K: 

write 

4 = 

v(s^) 

L : 
n 

v(s  ) 

n 

Figure  3.  Second  solution  to  reader-writer 
protlem. 


Clearly  any  decoder  h from  to  P will  have 
to  map  h(Cj)  = c^ , h(Ej)  = e^,  h(H^)  = and 
h(K)  * k.  If  h(j^)  = J,  i 1,  then  for  x * 
and  f • C^,  d(x,f)  = n + 1 and  h(xf)  » c^^eP,  while 
if  h(Jj)  = J,  for  X “ J,  and  f = C,,  d(x,f)  = 
r.  + j.  Thus  delay  ^ n + 1. 

Thus  ^ introduces  delays  that  are  unbounded 

f. 

as  a function  of  the  number  of  readers  present. 
Therefore,  delay  (4,P)  is  a quantitative  measure 
of  efficieney  which  agrees  with  the  Intuition  that 
is  a better  solution  than  Qg. 

The  above  differences  become  even  more  inter- 
esting if  we  allow  different  cost  functions. 

For  example,  we  may  want  to  use  a weighted 
length  function  c.  Observing  that  most  of  the 
time  is  actually  spent  in  the  "read"  and  "write" 
sections  of  the  program,  we  may  assign  to  the 
"read"  and  "write"  actions  weight  t » 1 while  all 
other  actions  in  and  P get  assigned  weight  1. 

With  r'-spect  to  this  cost  function,  delay 
((}^,P)  is  still  3.  However,  delay  (Qg,?)  ^ n + t 
since  for  t>ie  above  values  of  x and  f,  the  program 
has  to  go  through  the  "write"  section  In  order  to 
release  the  reader. 

Ii.  Existence  Theorems 

In  this  section  we  give  proofs  of  various 
simulation  results  concerning  Dljkstra's  P and  V 
primitives . 

in  our  previous  work  [5],  [6],  [8],  we  have 
shown  that  with  respect  to  a suitable  notion  of 


"simulate",  Tl  systems  are  too  weak  and  cannot 
simulate  even  rather  simple  synchronization  prob- 
lems. Many  readers  of  our  work  objected  to  "sim- 
ulate" as  being  too  strong,  based  on  the  intuitive 
feeling  that  PV  is  "universal".  Using  the  "sIjbu- 
latCj^"  relation,  we  now  show  that  PV  is  "universal" 
in  the  sense  that  for  any  asynchronous  program  P, 
there  Is  a P’.’  program  Q such  that  i simulatCj^  P, 
for  some  k.  However,  k grows  unboundedly  as  a i 

function  of  the  size  of  P. 

In  the  following,  we  will  use  the  when. . .do 
notation  introduced  in  [5]: 

when  6 ^ 0 

where  6 is  a predicate  and  0 is  a statement  means 
that  0 is  executed  only  if  6 is  true.  Otherwise, 
control  is  interrupted  ’until  such  time  as  6 is 
true. 

Definition : A ^ asynchronous  program  is  an  asyn- 
chronous program.  P such  that  there  is  a distin- 
guished subsety’i  of  the  program  variables  (the 
elements  of..i  are  called  semanhores ) which  can 
only  be  used  by  actions  of  the  form  P(S)  or 
V(.'),  S E/i,  ([2])  where 

P(S)  is  when  S>0^S-eS-l  and 
V(S)  is  when  true  do  S ♦ S + 1 
Theorem  1.  For  every  asynchronous  program  P, 
there  exists  a non--.ec-’t i ve  integer  k and  a PV 
asynchronous  prorra-t  ^ rush  that  £ simulate^^  P, 
with  length  as  cost  function. 

Proof.  Let  P be  an  asynchronous  program  and  sup- 
pose P consists  ol  n actions  of  the  form 

(l)  when  do  0^ 


(n)  when  6 do  0 
n n 

We  constr'jct  Q as  nn  asynchronous  program 
containing  n + 1 processes,  where  the  first  n are 
constructed  from  the  n actions  of  P and  the 
n + 1 -St  is  a "monitor".  The  monitor  can  act- 
ually be  incorporated  into  the  individual  process- 
es, but  its  isolation  as  a separate  processes  en- 
hances the  efficiency  and  readability  of  the 
program. 

For  the  1-th  action  of  P,  construct  the 
following  process  in  Qi 
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(1)  L^: 

(2) 

(3) 


proee38-l 

P(Sj) 

P(S) 

w w ♦ 1 


the  critical  section  it  acknowledges  that  it  is 
ready  to  execute  and  waits  on  (6)  for  release.  If 
all  pending  processes  have  so  acknowledged,  one  of 
them  is  enabled  in  line  (U).  Note  that  the  sched- 
uling responsibility  has  not  been  usurped  by  this 
simulation  in  the  sense  of  deciding  which  process 
will  execute  next. 


(U) 

(5) 

(6) 

(7) 

(8) 
(9) 

(10) 

(U) 

(12) 

(13) 


w ■ np  then  V(E) 
V(S) 

P(E) 

if  ok  = 1 then 
®i 

ok  0 

w *■  w - 1 

^ w > 0 then  V(E) 
else  V(M) 


£Oto  L^; 


Where  S is  a mutual  exclusion  semaphore  (in- 
itial value  1)  used  to  protect  the  critical  section 
(2)-(5),  E is  a semaphore  (initial  value  0)  used  to 
release  all  actions  that  may  execute  at  a given 
step  (the  "ready-set"  in  the  terminology  of  [5]). 

M is  a semaphore  (initial  value  l)  used  for  commun- 
ication wit.h  the  monitor.  3^  is  a local  semaphore 
(initial  value  0)  which  is  enabled  at  a given  step 
if  the  1-th  action  may  execute  at  that  step.  The 
variable  w is  a counter,  np  is  a variable  giving 
the  number  of  actions  that  may  execute  at  any  step 
and  ok  is  a flag. 

The  monitor  process  is  given  by 
LM:  P(M) 


ok 

np 


d(  S j , . . * t ) 


t - <>(B^ B^) 

if  q(t,l)  then  V(Sj^) 


^q(t,n)  tlien  V(S^) 
goto  IM; 


4 is  1 function  that,  computes  the  number  of 
procesr.f  r.  that  may  execute  given  the  values  of  the 
Bi's  and  is  a function  that  figures  out  which 
processes  may  execute  and  encodes  this  information 
into  t.  q(t,i)  will  d'-codc  t and  enable  Sj  accord- 
ij.gly . 

The  monitor  starts  and  enables  some  process-i 
then  enters  its  critical  section  (2)-(5).  Inside 


Assuming  process  J Is  the  first  to  execute 
beyond  line  (F),  and  since  ok  will  be  1,  it  will 
execute  0j,  disable  all  others  from  executing  (9) 
(since  executing  9^  could  have  char.ged  which  pro- 
cesses may  now  proceed),  acknowledges  that  it  has 
pused  (lO)  and  then  releases  another  process  if 
not  all  have  been  released  (11),  otherwise  it 
releases  the  monitor  (12). 

Let  h((8)^)  = i and  h(f)  * ^ for  all  other 
actions  in  Q.  Evidently  h(a)  « P.  To  bound  the 
efficiency  of  the  simulation,  observe  that  be- 
tween any  two  consecutive  observable  actions  (8)^ 
and  (8)j,  r bookkeeping  actions  are  executed, 
where 

r<^5u  + 2n  + 8 + 5v 

where  u is  the  number  of  processes  that  may  exe- 
cute after  (8)j  and  v the  number  that  may  execute 
after  (8)j.  Eince  u,v  ^ n,  k is  bounded  by 
12n  + 8. 

The  proof  of  Theorem  1 suggests  another  cost 
function  — the  number  of  observable  actions  in  a 
word.  Let  us  denote  this  cost  function  by  c^. 

Then  we  have  the  following: 

Corollary.  For  every  asynchronous  program  P, 
there  exists  a PV  asynchronous  program  Q such  that 
Q simulate^  P with  cost  f'cnction  c^ . 

Proof.  Immediate  from  the  proof  of  Theorem  1, 
since  there  are  only  bookkeeping  actions  between 
(8)j  and  (e)j. 

In  [ 8 ] , we  have  shown  that  FV  systems  with 
only  binary  ( (0 ,1) -valued)  semaphores  are  strictly 
weaker  than  PV  systems  in  the  sense  that  +herc  are 
iV  .systems  that  cannot  !•'  simulated  by  a.".y  FV  sys- 
tem with  only  binary  semaphores.  However,  we  have 
the  following 

Theorem  ?.  For  every  FV  asynchronous  program  P, 
there  is  a^  nstTchronous  t rogra."i  Q with  on ly 
biliary  semaphores  such  that  Q simulate^  P,  with 
length  as  cost  function . 
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Proof.  Tile  construction  Is  essentially  sketched 
in  [ 2 ] . For  each  senaphore  S in  P,  add  a new 
mutual  exclusion  semaphore  E (initial  value  1)  and 
a new  integer  variable  x (initial  value  0).  Q is 
obtained  from  P by  replacing  each  P(S)  by 

P(F.) 

X -e  X - 1 

if  X < 0 then  begin  V(E); 

P(S)  end 

else  V(E); 

and  V(S)  by 

P(E) 

X «-  X + 1 

if  X ^ 0 then  V(S) 

V(E) 

Let  the  third  line  in  each  expansion  be  the 
observable  action.  Then  clearly  h(x)h(f)  e P 
Implies  d(x,f)  ^ 4. 
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